Online proctoring process for distance-based testing

ABSTRACT

A system for enabling real time live proctoring of an exam across a distributed network includes a first remote computer. The first remote computer is capable of real time audio visual capture and display of an image of a user of the first remote computer. A second remote computer is capable of real time audio visual capture and display of an image of the user of the second remote computer. A server is in communication with the first remote computer and the second remote computer, and provides an interactive web based scheduling portal accessible from the first remote computer and the second remote computer. A database is associated with the server for storing data regarding the rules for proctoring of an exam including the rate at which an exam may be proctored at a given date and time. The server enables access to a virtual exam room by the first remote computer and the second remote computer in response to a request from the first remote computer through the scheduling portal for a date and time to take an exam administered at the first computer when the requested date and time fulfils the rules stored in the database.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims priority to U.S. Provisional Application No.61/295,508 filed on Jan. 15, 2010 in its entirety.

BACKGROUND OF THE INVENTION

This invention is directed to a system and method for proctoring anexam, and more particularly, for remotely proctoring an exam across adistributed network.

Since the invention of the classroom, their have been exams to determinehow well a student has learned the subject matter. With the advent oflarge classes, and written exams, the monitoring (proctoring) of examshas been a necessity. As well known in the art, teachers, and then laterprofessional proctors, remain in the classroom to observe the examtaking procedure to prevent false results through cheating. This inperson proctoring of exams has been satisfactory for use in conventionaleducation environments. However, the advent of distance learning byeducational institutions such as Andrew Jackson University, theUniversity of Phoenix and others have made it impracticable topersonally monitor each student taking an exam because without thecommonality of the physical classroom, the students are too widelydisbursed.

Many institutions and companies faced with this problem have attemptedto circumvent it by diluting the course requirements and eliminating therequirement of a proctored exam in lieu of written papers or projects.Those institutions who had tried to solve the problem approached thesituation with a high level of automation and the lowest level of humaninteraction possible making the system rife for fraud.

Accordingly, a system and method for overcoming the shortcomings of theprior art by enabling a live proctor to monitor a student's examprocess, including student identification, as well as the immediate examenvironment is desired.

SUMMARY OF THE INVENTION

FIG. 1 is a schematic view of a system for providing remote proctoringin accordance with the invention;

FIG. 2 is an example of a log in portal for use by the exam takingstudent in accordance with the invention;

FIG. 3 is an example of a scheduling screen presented in accordance withthe invention;

FIG. 4 is an exemplary screen shot of a reservation interface inaccordance with the invention;

FIG. 5 is a scheduling portal with countdown clock in accordance withthe invention;

FIG. 6 is an exemplary screen shot showing the beginning of an exam;

FIG. 7 is a flow diagram of the operation of the system in accordancewith the invention;

FIG. 8 is an exemplary screen shot of the interaction between a proctorand a student in accordance with the invention;

FIG. 9 is a screen shot of a collection of proctor reports in accordancewith the invention;

FIG. 10 is a screen shot for setting the parameters of the exam throttlein accordance with the invention;

FIG. 11 is an exemplary screen shot of the administrator screen showingthe administration schedule in accordance with the invention;

FIG. 12 is an exemplary screen shot enabling a student to schedule anexam in accordance with the invention;

FIG. 13 is a screen shot of an interactive page for a school report inaccordance with the invention;

FIG. 14 is a screen shot showing the manner in which a proctor accessesan appointment in accordance with the invention;

FIG. 15 is an exemplary screen shot of an edit menu to be utilized by aproctor in accordance with the invention;

FIG. 16 is an exemplary review of a contact window for the proctor toaccess contact info for a particular student in accordance with theinvention;

FIG. 17 is an exemplary screen shot of a proctor's administrativeconsole in accordance with the invention;

FIG. 18 is an exemplary screen shot enabling an administrator or proctorto edit or add users to the system in accordance with the invention;

FIG. 19 is an exemplary screen shot of an administration console to beutilized by the institution providing the exam to be proctored inaccordance with the invention;

FIG. 20 is an exemplary screen shot enabling the setting by the schoolof the exam parameters in accordance with the invention; and

FIG. 21 is an exemplary screen shot of a cancellation report inaccordance with the invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT

Reference is made to FIG. 1 in which a system, generally indicated as10, is provided which enables remote proctoring of an exam, even inparallel with an online exam administered to a student 14. System 10includes a server 12 operatively communicating with a database 22.Server 12 communicates with students 14 at a student computer 16 throughinternet 18. Server 12 may also communicate with third party databases20 such as institutions of learning (where exams may be stored),identity bureaus (where identifying data about a student is stored), oreven provider's executable programs (such as exams or schedulingfunctions such as the virtual classroom to be discussed below) in oneembodiment of the invention.

In a preferred embodiment, server 12 provides an interactive web basedportal such as a web page for interacting with student 14. It should benoted that a webcam 24 is associated with computer 16.

Similarly, server 12 provides an interactive web based portal forproctors 34 and a proctor computer 30 which is also equipped with awebcam 32. Server 12 enables two way audio visual communication betweencomputer 30 and computer 16 utilizing webcams 32, 24. It should be notedthat computer 16, 30 may be any interactive device which allows each ofstudent 14 and proctor 34 to communicate with each other utilizing thefunctionality described below. It should be noted that the preferredembodiment is an internet based system to facilitate the use of server12 and third party database 20 with its associated servers. However, thecomputing device may be anything compatible with a webcam or other realtime audio visual device and capable of such communication utilizingeither the internet, radio frequency, telephone, cable TV, handheldpersonal data accessories or smart cellular phones by way of nonlimitingexample.

It should be understood as well, that all of the functionality describedbelow is capable of being performed by server 12 utilizing data storedat database 22. However, in a distributed network such as distributednetwork 10, it is contemplated that certain data and certainfunctionality may also be provided by third party 20 platforms. So bythe way of example, server 12 may create the platform for two way audiovisual communication, or provide the handshake between computer 16,computer 30 and a third party 20 platform.

Reference is now made to FIG. 7 in which a schematic diagram of theoperation of system 10 is provided by way of background. In general,server 12 facilitates the activation and use of virtual exam rooms 36.Virtual exam rooms 36 are virtual constructs which mimic thefunctionality of a real world exam room in that it is a “place” in whichan exam may be administered under the supervision of a live proctor 34at proctor computer 30.

As will be described in greater detail below, virtual exam room 36 is aplatform which enables the functionality which creates an exam room inresponse to a scheduling request. In other words, virtual exam room 36is a communication between proctor computer 30 and student 16 reservedand enabled for a specific time and date and enabled upon server 12confirming the availability of a time and date for the administration ofan exam to a requesting student 14. Virtual exam room 36, as it “goeslive” also is enabled for the proctor and student webcam servers,monitoring of the student computers, presentation of the exam to thecomputers in the virtual exam room and third party authentication. Itconnects these applets in a website page.

Generally a student 14 utilizes student computer 16 to communicate withserver 12 to access a scheduling portal 38. Scheduling portal 38provides a student with a schedule of available time periods by date andtime during which an exam is capable of being proctored utilizing thesystem of server 12. Student 14 selects an available date and time whichcauses the creation of a virtual exam room 36. A proctor 34 utilizing aproctor computer 30 also accesses scheduling portal 38 to identify examtimes for which a proctor 34 may be needed, or a schedule of virtualexam rooms 36 to which proctor 34 has been assigned.

The virtual exam room 36 provides the linking platform between proctorcomputer 30 and student computer 16 as a proctor 34 and a student 16 areboth assigned to a virtual exam room 36. Utilizing virtual exam room 36and utilizing respective webcams 24, 32 and a communication platformprovided at server 12, or from a third party 20, student computer 16 andproctor computer 30 provide images respectively, in real time, of theproctor 34 and the student 16 making use of the virtual exam room 36 toadminister an exam. Virtual exam room 36 also enables proctor 34 to viewwhat is being displayed on a screen of student computer 16.

Human proctors are utilized by the invention to monitor students 14taking exams in real-time. Since the majority of all exams taken outsideof a classroom environment are delivered online, in a preferrednonlimiting example, the internet 18 is used for connection between thestudent 14 and proctor 34. The rest of the process is performed in a setof logical steps.

The Student Process

The process begins with student 14 accessing a Scheduling Portal 38, awebsite that server 12 runs utilizing database 22. A student 14 wishingto schedule a time to be proctored is provided with a login to theScheduling Portal 38 (FIG. 2). As student 14 enters log in formation,server 12 creates a unique user number that is entered into the database22 and is the identifier for all data collection related to this student14. As student 14 creates their login they are prompted by server 12 toenter contact information into system 10 including mailing address,phone numbers, and email addresses by way of nonlimiting example.Student 14 is also prompted to enter their local time zone at computer16. Once the time zone is entered, all presentations of appointments andcurrent time are presented to student 14 in their indicated local time.

Once an appointment time is created by server 12 as a function ofstudent inputs at scheduling portal 38, the appointment time is storedin database 22 and recorded in Coordinated Universal Time (UTC). System10 maintains a central clock that runs on UTC and is constantly updated.

Times are converted by server 12 checking the database 22 recordassociated with the student 14 to determine what time zone they haveselected. Server 10 then retrieves the recorded difference between UTCand the student's time zone from database 22 and makes the addition orsubtraction to the UTC time of the appointment. The server 12 alsotracks dates when the difference is set to change for Daylight SavingsTime and makes the necessary addition or subtraction. This new time isthe one shown to student 14 at computer 16. All times are convertedbefore an email is sent to the student confirming information about thetime and date of an exam.

All times displayed on any web page in the schedule are converted to thestudent's time zone before being written to the page presented atcomputer 16. For example: if a student 14 makes an appointment for 11:00AM Central Time, server 12 checks the current difference between UTC andCentral. Since the difference may be −6, in this example, server 12 adds6 hours to the appointment and records it on the schedule at 5:00 PM,which is UTC time. When the student is emailed the confirmation for thisappointment, the system will check database 22 for the student's timezone. Server 12 determines that the appointment is recorded at 5:00 PMUTC and that the student's time zone is Central Time. Server 12 thenchecks database 22 for the difference between Central Time and UTC andreturns −6. Server 12 then takes 5:00 PM and subtracts 6 hours to get11:00 AM. This 11:00 AM time is then inserted into the email deliveredto computer 16.

Once a login account is created for student 14, student 14 has theability to login at a login page 200 to system 10 at any time using thecredentials they entered in the sign up process. Upon the next login,student 14 is given the option at a scheduling screen 300 (FIG. 3) toselect a date and time they wish to take an exam. Available dates 306and times 310 are shown as white boxes 302 on a calendar grid. Whiteboxes 302 can be selected at computer 16 to add an appointment at thecorresponding date 306 and time 310. Dark squares 304 indicateunavailable times.

As will be seen, system 10 utilizes live actual monitoring of studentidentification and behavior, therefore each student 14 must be assignedan available proctor 34. This schedule is a function of schoolparameters such as exam date, time and duration, by way of nonlimitingexample, on the one hand, and proctor 34 availability and the maximumnumber of students that can be handled by a single proctor 34 on theother.

Server 12 determines open dates by enabling an available virtual examroom 36 as a function of exam and proctoring rules created as a functionof the school parameters stored at database 22. These virtual exam rooms36 are stored in database records with associated variables held inother database records. These variables control an associated URL of thepage student 14 is to be sent to take their exam. In other words, server12 may send student 14 to a virtual room 36 created by a third party 20,or create virtual rooms itself as a function of data stored in database22. The variables may include the room's name, which is usually anumber. The name of the virtual exam room 36 is mapped in database 22 tothe login information required by the proctor 34 to connect the webcams22, 32. The number of exam rooms 36 also may correspond to rulesgoverning the capacity of exams that can be proctored at any given timeas stored in database 22 (see FIG. 10).

Each virtual exam room 36 has time slots allocated to allow an exam tobegin at staggered intervals controlled by an administrator, which iscurrently set at 15 minutes (see Admin Console Section below). Thisallows for a single proctor 34, but multiple students 34 in a virtualexam room 36. Only one exam appointment can be active in a virtual examroom 36 at a time, i.e. have a proctor 34 actively communicating with astudent 14, such as during the identification process discussed below.Virtual exam rooms 36 can be added and deleted in the Admin Console.

System 10 relies on live proctoring in a virtual exam room 36. Becauseproctoring is live, the system must be enabled to control the rate atwhich proctoring occurs. In this way, a single proctor 34 is notoverwhelmed in its attempt to initialize exams for a large number ofstudents 14 as initialization requires the steps of identityconfirmation, environment validation (e.g. no extraneous materials arepresent in a closed book exam by way of example), in addition to thevisual monitoring of the administration of the test once initialized. Tothis end, proctor 34 or an administrator of several proctors 34 isprovided with a throttle function to control the flow of students 14scheduling exams requiring proctoring.

Reference is made to FIG. 10 in which a screen shot 1000 shows a generalsettings input including an input page 1002 for inputting the manner inwhich reservations may be made such as in the instant case in which onlya single exam may be started at any one time and no more than five examsmay be proctored concurrently by any one proctor. It should be noted,that this is the gating function in the system and intentionally so. Itcontrols the number of exams which may be given in a virtual classroom36 at the same time. Therefore, it controls the number of exams whichmay be scheduled before a white box 302 is converted to a dark box 304at scheduling portal 38 by server 12.

The schedule also has a “throttle” for exam capacity. This functionalityallows changes to the number of virtual exam rooms 36 available forstudents 14 to reserve and will also affect the availability a student14 will see when they attempt to add an exam. This is done by theproctor's administration through an Admin Console (see Admin ConsoleSection). Operationally, human proctors can only manage starting amaximum of two exams at the same time. As discussed above, the throttlefunction allows management of how many proctors must be working at onceby controlling the number of exams that can begin at the same time andhow many exams that can run simultaneously.

For example: System 10 has ten active virtual exam rooms 36, and astudent 14 wants to schedule a two-hour exam at 10:00 AM. Server 12 willsearch for an exam room 36 that is open from 10:00 am until 12:00 pm.Once it finds a room 36, it will operate on the throttle settings storedin database 22 to determine how many exams are allowed to begin at once.Server 12 then determines whether adding the requested appointment willkeep it under that number. Server 12 then checks the throttle values todetermine the number of simultaneous exams allowed and determineswhether adding the appointment in that time frame will keep it underthat number. Once all of these conditions are met, server 12 addsstudent 14's appointment to the schedule 300.

As discussed above in connection with FIG. 7, server 12 enables aplatform for scheduling a virtual exam room 36, and as will be seenbelow, at the time and date scheduled, enables communication between acomputer 16 and computer 30 utilizing respective webcams 24, 32. Thisallows a third party 20 (which cumulatively and alternatively representsa server and database of nonproctoring entities) such as a university tomake available at its server the exam for access by computer 24. In thisway, the proctoring provided by server 12 and the exam provided by thirdparty 20 run in parallel, without interference, at computer 24. It isnot necessary, unless desired by third party 20, for proctor 34 to haveaccess to or see the exam itself. In this way, system 10 provides anexam platform agnostic proctoring system.

Each third party institution 20 is given the opportunity to customizeits interface for their test-takers, so a student 14 will indicate theexam they intend to take by either typing the name of the exam intocomputer 16 or selecting at computer 16 from a pre-populated exam listprovided at a web page provided by a third party 20 or server 12. Thirdparty 20 can set an infinite number of variables associated with eachexam. Some of these variables can include the dates and times the examis available, the name of the exam, the associated faculty member, andexam length. These variables can be stored at database 22 eithermanually by proctor administrators through the Admin Console (See AdminConsole Section). They can also be populated automatically from theinstitution's own database 20. This is done by the institution makingthe data available in a readable format to server 12 (for example, anXML file). The data from the institution's system is requested andreturned to the server 12 any time a student wishes to add anappointment.

No matter the method that the exam variables are entered into system 10,the same process is performed by student 14 when attempting to add anappointment. Student 14 selects a date and time they wish to take anexam at page 300 of scheduling portal 36 (FIG. 3). Server 12 provides areservation page 1200 at computer 16 and server 12 populates a drop downlist 1202 of available exams with data from third party 20 or stored indatabase 22 with each entry (FIG. 12).

Student 14 selects any variables that the institution desires at a page400 (FIG. 4). When the student 14 selects the exam and attempts to addit to the schedule 300, server 12 will first determine the associateddatabase entries to determine whether the exam is available at the dateand time the student 14 is requesting. If it is not, server 12 sendsstudent 14 an error message at computer 16 and is advised by server 12as to when an appointment is available. If the exam is available in thetime frame student 14 is requesting, system 10 performs its normal setof checks for available virtual exam rooms 36 as a function of rulesincluding throttle settings. If server 12 determines that settings allowit, an appointment for student 14 is added to the schedule 300.

Student 14 is given the opportunity to print a confirmation page andserver 12 sends a confirmation via email to computer 14. Student 14 isthen returned to the calendar grid 300 of scheduling portal 36.

Server 12 generates a countdown clock by comparing current time to thescheduled appointment time, which is displayed as a clock 308 in theschedule 300. Clock 308 counts down until the time the exam is scheduledto begin. This countdown clock is calculated by server 12 firstrecognizing that the student 14 has an appointment on the schedule 300.Server 12 then takes the time of the next appointment student 14 has onschedule 300 (in UTC) as stored in database 22 and subtracts the currentdate and time (in UTC) from the appointment date. The difference is thendisplayed on the schedule grid page 300 as clock 308 and is periodicallyupdated; every second in a preferred embodiment (FIG. 6). Once the examis scheduled to begin, the countdown clock 308 becomes a button 312 thestudent can select to begin the proctoring session (FIG. 6). Thisprocess is done when server 12 calculates the difference between theappointment time and current time is zero or a negative number. Thebutton, in a nonlimiting embodiment, is a html link to a URL thatcorresponds to the virtual exam room 36 in which the student'sappointment is scheduled.

Once the student selects virtual button 312, server 12 provides a newpage at computer 16 to begin the proctoring process. The first step isto connect proctor 34 and student 16 via a live webcam session. The newweb page automatically detects the student's webcam 24 and connects themto a live proctor's 34 webcam feed at computer 30 and webcam 32 (FIG.8). This is done via a live video conference executable application intothe page. This process may be done in a preferred embodiment through aplatform provided by third party 20, but can also be done by server 12.The webcam connection allows the student 14 and proctor 30 to see andhear each other. The proctor 30 then greets the student 14 and talksthem through the next steps.

Student 14 is then instructed to proceed to the next step utilizing aninterface 800 (FIG. 8, step two). Student 14 initializes a remoteconnection to proctor 34, which allows proctor 34 to monitor thestudent's screen and system for computer 16. The connection also allowsthe proctor to control the peripherals (mouse and keyboard) of computer16 and monitor the system health of computer 16, which aids in technicalsupport needs. This is done through a third party 20, but can be done byserver 12. This method currently works on both Windows and Maccomputers. This capability is tied to the technology used, whether froma third party or from server 12.

From there, the student 14 is instructed to prove their identity throughan approved authentication method. Examples of authentication methodsinclude: Proctor 34 instructs the student to present pictureidentification to webcam 24. The type of identification acceptable isdetermined by the institution for which the student 14 is taking theexam and stored either at database 22 or third party database 20 andsent to proctor 34 as part of the process. Student 14 may also be askedto enter their name and home mailing address into a pop up windowpresented at computer 16, but monitored at server 12 and/or computer 30.This data may be transmitted to a third party 20 which in responsereturns a series of questions generated from data stored at third partydatabase 20 related to the student 14 at computer 16. This could bepublic and privately purchased data that deals with previous addresses,real estate history, old phone numbers, and other types of informationgenerally known collectively only to the student 14 by way ofnonlimiting example. Student 14 is to answer the questions while proctor34 watches via webcam 24 and remote connection. If student 14 scores ahigh enough percentage on the authentication exam, they are allowed toproceed.

The percentage can be determined by the institution or proctor 34. Thepassing or failing of this authentication exam, as well as the contentsof the questions are stored in the database of third party 20. Thestudent may also have a picture taken of them through webcam 24 by theproctor 34. This picture is then stored in database 22 and associatedwith student 14. It can be viewed by proctor 34 at any time to verifythat the appearance of the student 14 who has connected via webcam 24appears to be the same student 14 who has taken previous exams. Anycombination or all of these three methods can be used to authenticate astudent's identity at the discretion of the institution.

After the completion of the steps above, student 14 is instructed tobegin the exam. If the exam is being delivered online, student 14 isdirected to open another browser window and navigate to the exam on thewebsite of third party institution 20. System 10 does not require theexam to be delivered in any specific fashion and works with any LearningManagement System (LMS). The reason the system works with any LMS isthat system 10 enables viewing at computer 30 the images displayed oncomputer 16 so that proctor 34 is simply monitoring what is being shownon the student's monitor. For example, if an institution wants thestudent to use a Microsoft Word during the exam, the proctor simplymonitors the student doing so and makes sure they use nothing else. Thisallows system 10 to be platform agnostic. The proctoring is going on inparallel with whatever else student 14 is doing on computer 26.

If the exam is being delivered via paper, proctor 34 will instruct thestudent to complete the exam while on webcam 24 and will make surestudent 14 completes it in the manner directed by the institution.

After the exam is complete, student 14 “clocks out” by entering an endinstructed at computer 16 and proctor administrators, as well asselected administrators of the institution, are able to generateActivity Reports 900 (not shown) detailing all past proctoring sessions.If the exam times out then proctor 34 can also end the exam fromcomputer 30, or server 12 may discontinue access to the exam. Anyvariable that the institution wishes to be tracked can be displayed fromthis report. The report is generated by providing to computer 30 anumber of drop-down menus 1302 at a page 1300 that contain variablesthat allow the Administrator to narrow down the data that is displayedin any given report (FIG. 13). The number of drop-down menus can becustomized at the desire of the institution. A report 902 can contain,but is not limited to, pictures 904 of the student 14 who appeared onthe webcam (if it was recorded), the start 906 and end 908 times of theexam, the time the student began and ended the exam, and notes 910 fromthe proctor (FIG. 9) shown at screen 900. Administrators are also ableto see future exam appointments, manage lists of exams, and monitordaily schedules.

The Proctor Process

Operation of system 10 will now be explained as utilized by proctor 34.Proctors 34 are provided a different type of login into the System 10.These system 10 logins allow the proctors 34 to access the schedule 300of scheduling portal 38 in a view that allows proctors 34 to quickly seethe information at computer 30 they need in order to proctorefficiently.

Proctors 34 login from computer 30 though login process similar inoperation to that used by a student 14 (FIG. 2). Once proctor 34 logsin, server 12 provides access to a page 1100 at computer 30 thatdisplays the schedule 1102 in “Proctor View.” Schedule 1102 is displayedshowing the total number of virtual exam rooms 36 and all potentialstart times 1104 for the current day (FIG. 11). All proctor 34appointments 1106 for that day are displayed in line with theircorresponding virtual exam rooms 36 and the time they are set to begin.All appointments 1106 are color-coded by the institution for which theexam is being proctored. These colors are set in the Admin Console (seeAdmin Console section). This allows the proctor 34, at a glance, to knowwhat login information to use to connect the webcams and what school'sguidelines are to be consulted for this appointment 1106 as stored indatabase 22.

Above the display of virtual exam rooms 36 is a calendar 1100 accessiblefrom computer 30. Each day on calendar 1108 can be accessed to displayall appointments for that day in the corresponding virtual exam rooms36.

Any appointment on the schedule can be clicked by a proctor 34. Thiswill provide an accessible menu on page 1100 that offers proctor 34 thefollowing options: Edit; Notes; Contact; and Cancel. (FIG. 14).

The Edit Function:

When the proctor 34 selects Edit button 112 at computer 30, server 12connects proctor 34 to a new page 1500 that pulls all data from thedatabase 22 or third party 20 associated with this appointment 1106(FIG. 15). Proctor 34 can edit any variable associated with thisappointment 34. This can include, by way of example, but is not limitedto the following: The ability to change the student 14 listed with thereservation 1106; The ability to change the name of the exam; Theability to change the start and end times of the appointment 1106; Theability to change the notes the student may have left at the time theappointment was made.

The Notes Function:

By selecting Notes button 1114 server 12 provides access to a windowthat allows a proctor 34 to add text to database 22 and associate thistext as “notes” about the proctoring appointment 1106. The notes mayincluded, by way of example, but are not limited to, something student14 did during appointment 1106, something proctor 34 noticed, ortechnical issues proctor 34 had connecting to the student 14. This datais displayed in the Activity Report 900 and can be viewed by proctors 34and administrators from the institution.

Contact Function:

By selecting Contact button 1116, server 12 provides a pop up window1600 that contains the contact information 1602 contained in database 22that corresponds to this student's account (FIG. 16). Pop up window 1600may also display the picture 1604 on file for that student 14, allowingthe proctor to verify visually the student's identity as apart of anauthentication process.

Cancel Function:

Selection of Cancel button 1118 causes server 12 to allow proctor 34 tocancel an appointment 1106. A reason for cancellation may be included ina text box that will be recorded in database 22 and linked to thisappointment 1106. This information can be pulled from the “CancellationReport” in the Admin Console (see Admin Console).

Proctors also have access to the Admin Console which provides certaindegrees of initialization and administrative control over system 10 andwill be described below. Proctors 34 and Administrators have access to aScheduling Portal's Admin Console 1700 (FIG. 17). In the Admin Console1700, variables contained in database 22 that control mainline settingsof the Schedule Portal 36 can be edited.

The Schedule Button:

Selecting Schedule button 1702 from Portal's Admin Console 1700 causesserver 12 to return the page displayed at a computer to the “ProctorView” of the schedule 1102.

The Users Button:

By selecting a Users button 1704, server 12 enables an Administrator toadd, edit, and delete information about all proctors 34, administrators,and students 14. This is done through a menu 1800 that allows displaysof all profile information for each account (FIG. 18). If theAdministrator wishes to add a new user, they enter the information froma remote computer corresponding to the new user and select the “add”button 1802 Server 12 causes a new set of records to be added to thedatabase 22 and the user is given a unique User Number. If theAdministrator wishes to edit an existing user, they select the user'sname from the drop down box 1804 labeled “User.” All existing profiledata in database 22 for the user is displayed and can be edited by theproctor 34. When finished, selecting the “Update” button (not shown)will cause server 12 to update all the information associated with thisuser in database 22. Selecting a “Delete” button will cause server 12 todelete all information about the user from the database 22.

The Test Station Button:

Selecting a Test Station button 1706 causes server 12 to enable theAdministrator to create and edit all of the virtual exam rooms 36. Adrop down box appearing at their computer enables administrators toselect an existing exam room 36 or add a new exam room 36. All of thevariables mentioned in the virtual exam room section above can be editedhere. Virtual exam rooms 36 can be deleted from the database 22 (orthird party 20) by selecting the exam room 36 in the drop-down menu andselecting the “delete” button.

The General Button:

Selecting General button 1708 causes server 12 to enable anadministrator to edit many of the general settings of the site such asthe throttle rate at page 1000 (FIG. 10). In addition to thesefunctions, the main contact information for the site is edited here.Administrators can also use this section to edit the hours of availabletime slots by selecting an “open and close” time. This changes thedisplayed time slots that are shown to proctors 34 and students 14 inthe schedule grid 300. The increment at which time slots are available(currently set at 15 minutes) can be changed here as well. The Terms ofService for the site can be edited here as well.

The User Types Button:

Selection of a User Type button 1710 causes server 12 to enable theAdministrators to edit the data stored in database 22 for differenttypes of users in the system, such as “proctor,” “student,” and“institutional admin.” In editing these user types, variables thatcontrol their access to certain sections of the schedule 300 and AdminConsole 17 and permissions to perform certain access can be edited here.Some of these variables include, but are not limited to, the ability toadd appointments, the ability to view proctor comments, and how long auser is allowed to stay logged into the system without being prompted tore-enter their login credentials.

The Schools Button:

Selection of a Schools button 1712 causes server 12 to enable anAdministrator to add, delete, and edit data about an institution storedin database 22 (FIG. 19). Server 12 provides access to a page 1900 wheresettings for institutions can be customized. The sections include, butare not limited to, setting up the school to use exam lists (specificsettings for each list is controlled as described in the Exam Listsection); and editing the email message that is sent to a student 14 ofthe institution when they make an appointment.

The Exam Lists Button:

Once an institution has been edited utilizing page 1900, theAdministrator selects the Exam Lists button 1714. Server 12 in responseto selection of the Exam List button 1714 enables an Administrator toadd exams to database 22 or edit exam information in database 22. Asdiscussed above, each exam from each institution and variablesassociated with it are stored and mapped in database 22. These variablesmay be set, edited or deleted as discussed above in the Exam List andAppointment Section.

The Cancel Codes Button:

Selecting a Cancel Codes button 1718 causes server 12 to enable theAdministrators to set generic reasons that proctors 34 can select whencanceling a student's exam appointment.

The History Button:

Selecting a History button 1720 causes server 12 to enable anAdministrator to access reports from database 22 on the addition ofusers, the addition or changing of appointments, and the changing ofsystem settings as stored in database 22 as server 12 performs thefunctions discussed above. All changes in database 22 regarding thesefunctions are logged in another section of the database, allowing forchange reports to be displayed. This information is used fortroubleshooting a problem after it appears to have happened to pinpointthe changes that may have caused it.

The Activity Report Button:

Selecting an Activity Report button 1722 causes server 12 to provideAdministrators with access to the same Activity Report 900 thatinstitutional administrators use.

Cancellation Report Button:

Selecting a Cancel Report button 1724 causes server 12 to provideAdministrators with access to report on all appointments that have beendeleted or canceled. In the same manner that Activity Report 900 isgenerated, relevant variables can be selected at a page 2100 to narrowthe data returned so that all that is used is the information desired(FIG. 21).

Email Button:

Selecting Email button 1726 causes server 12 to enable Administrators tosend an email to any or all users of Schedule Portal 38 at the emailaddress recorded in the database 22 that corresponds to their userprofile.

The innovation behind the above approach is the virtualization of thetraditional classroom testing experience. The use of human interactioncombined with authentication methods maximizes the security andintegrity of the proctoring session without making the process difficultfor the student. Other systems focus on automation and not monitor inreal time.

1.-13. (canceled)
 14. A system for live proctoring of an exam across anetwork, the system comprising: at least one centralized server and atleast one memory for executing the following steps: receiving schedulinginformation from a first remote computer; determining availability ofone or more proctors; controlling the flow and availability ofappointment times for the available one or more proctors; scheduling anappointment between a test taker associated with the first remotecomputer and a proctor associated with a second remote computer;receiving a connection request from a first remote computer, the firstremote computer comprising a webcam and a two-way video communicationsystem; sending a connection request to the second remote computer, thesecond remote computer comprising a webcam and a two-way videocommunication system; providing a virtual exam room to the test takerand the proctor; relaying live audio and video between the first remotecomputer and the second remote computer; allowing the proctor toremotely view and control the first remote computer; and generatingactivity reports.
 15. The system of claim 14, further comprising a thirdparty server for test taker identity verification.
 16. The system ofclaim 15, wherein the verification comprises enabling a test taker torespond to a first set of questions at the first remote computer,transmitting the response to the third party server, transmitting asecond set of questions to said first remote computer as a function ofthe response to the first set of questions, authenticating the testtaker using a response to the second set of questions.
 17. The system ofclaim 14, further comprising limiting a volume of test takers that canenter a particular exam room at a specific time based on exam durationand resource availability.
 18. The system of claim 14, furthercomprising balancing exam start times using a throttle, wherein thethrottle comprises configurable rules regarding the number of exam starttimes that may be presented to the test taker for scheduling.
 19. Thesystem of claim 18, wherein the configurable rules comprise a ruleregarding a number of exam start times which may occur at the same timethe server controlling the rate at which an exam may be proctored at agiven date and time by storing the start times of enabled virtual examrooms and determining whether enabling access to an additional firstremote computer to the virtual exam room violates the rule.
 20. Thesystem of claim 18, wherein the configurable rules comprise a number ofvirtual exam rooms available as a function to at least one ofavailability of a second remote computer, time and date, the serverdetermining whether a request from the first remote computer would causea number of virtual exam rooms to exceed the number of virtual examrooms available as a function of the rule.
 21. The system of claim 14,further comprising determining a time in coordinated universal time andconverting the coordinated universal time to local time for the testtaker to select an appointment time.
 22. The system of claim 14, furthercomprising providing available times to the first remote computer toenable the test taker to schedule an examination appointment in theirlocal time.
 23. The system of claim 14, further comprising determining atime differential between a current coordinated universal time and thecoordinated universal time of a virtual exam room and creating acountdown clock that is displayed to the test taker prior to the examappointment time.
 24. The system of claim 23, wherein the countdownclock enables and links the test taker to the virtual exam room at theappointment time.
 25. The system of claim 14, wherein an image of thetest taker is taken by the first remote computer.
 26. The system ofclaim 14, wherein the reporting comprises one or more of images, video,start or end times of the session, and notes from the proctor.
 27. Thesystem of claim 14, wherein the system receives customized input fromone or more third-party institutions for the purpose of proctoring andadministering an examination.
 28. The system of claim 27, wherein thecustomized input consists of one or more of: examination data, timeavailability, duration, exam name, instructions for administration, andcombinations thereof.
 29. The system of claim 14, further comprisingauthenticating the test taker.
 30. The system of claim 29, wherein theauthenticating comprises one or more of verifying a physicalidentification card, reviewing a picture of the test taker from aprevious session, and using knowledge-based challenge questions.
 31. Thesystem of claim 14, wherein the system is platform agnostic.
 32. Thesystem of claim 14, wherein test taker profile information is updated bythe proctor.
 33. The system of claim 14, further comprising accessingone or more rules, wherein the one or more rules comprise a rate atwhich an exam may be proctored at a given date and time.